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HEARING SYSTEM BEAMFORMER 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present mvention relates to sound signal enhancement. 

2. Stateof the Art 

For the hearing unpaired, clearly hearing speech is very difficult for hearing 
aid wearers, especially in noisy locations. Discrimmation of the speech signal is 
confused because directional cues are not well received or processed by tiie hearing 
impaired, and the normal directional cues are poorly preserved by standard hearing 
aid microphone technologies. For this reason, electronic dhectionality has been 
shown to be very beneficial, and directional microphones are becommg common m 
hearing aids. However, there are lunitations to the amount of directionality 
achievable m microphones alone. Therefore, further benefits are being sought by the 
use of beamforming techniques, utilizmg the multiple microphone signals available 
for example from a binaural pair of hearing aids. 

Beamforming is a method whereby a narrow (or at least narrower) polar 
directional pattern can be developed by combining multiple signals from spatially 
separated sensors to create a monaural, or simple, output signal representing the 
signal from the narrower beam. Another name for this general category of 
processmg is "array processmg," used, for example, m broadside antenna array 
systems, uiiderwater sonar systems and medical ultrasouiid unaging systems. Signal 
processmg usually includes the steps of adjustmg the phase (or delay) of the 
uidividual input signals and then adding (or summmg) them togetiier. Sometimes 
predetermmed, fixed amplitude weightings are applied to flie individual signals prior 
to summation, for example to reduce sidelobe amplitudes. 

With two sensors, it is possible to create a direction of mayimiim sensitivity 
and a null, or direction of minimu m sensitivity. 
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One known beamfprming algorithm is described in U.S. Patent 4,956,867, 
incorporated herein by reference. This algorithm operates to direct a null at the 
strongest noise source. Since it is assumed that the desired talker signal is from 
straight ahead, a small region of angles around zero degrees is excluded so that the 
null is never steered to straight ahead, where it would remove the desired signal. 
Because the algorithm is adaptive, time is required to find and nuU out the 
interfermg signal. The algorithm works best when there is a single strong mterferer 
with little reverberation. (Reverberant signals operate to create what appears to be 
additional interfermg signals with many different angles of arrival and times of 
arrival~i.e., a reverberant signal acts like many simultaneous interferers.) Also, the 
algorithm works best when an interfering signal is long-lasting-it does not work 
well for transient interference. 

Hie prior-art beamforming method suffers from serious drawbacks. First, it 
takes too long to acquire the signal and null it out (adaptation takes too long). Long 
adaptation time creates a problem with wearer head movements (which change the 
angle of arrival of the interfering signal) and with transient interfering signals. 
Second, it does not beneficially reduce the noise in real life simations with 
numerous interfering signals and/or moderate-to-high reverberation. 

A simpler beamforming approach is known from classical beamforming. 
With only two signals (e.g. , in the case of binaural hearing health care, one from 
the microphone at each ear) classical beamforming simply sums the two signals 
together. Since it is assumed that the target speech is from straight ahead (i.e., that 
the hearing aid wearef is looking at the talker), the speech signal in the bmaural pair 
of raw signals is highly correlated, and therefore the sum increases the level of this 
signal, while the noise sources, assumed to be off-axis, create highly uncorrelated 
noise signals at each ear. Therefore, fliere is an enhancement of the desired speech 
signal over that of the noise signal in the beamformer output. This enhancement is 
analogous to the increased sensitivity of a broadside array to signals coming from m 
front as compared to those coming from the side. 
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This classical beamforming approach still does not optimize the 
signal-to-noise (voice-to-background) ratio, however, producing only a maxmium 
3dB improvement. It is also fixed, and therefore cannot adjust to varying noise 
conditions. 

SUMMARY OF THE INVENTION 
The present invention, generally speaking, picks up a voice or other sound 
signal of interest and creates a higher voice-to-background-noise ratio in the output 
signal so that a user enjoys higher mtelligibility of the voice signal. In particular, 
beamforming techniques are used to provide optimized signals to the user for further 
increasing the understanding of speech in noisy environments and for reducing user 
listening fatigue. In one embodiment, signal-to-noise performance is optimized even 
if some of die binaural cues are sacrificed. In this embodiment, an optimum mix 
ratio or weighting ratio is determined in accordance with the ratio of noise power in 
the binaural signals. Enhancement cu-cuitry is easily implemented in either analog or 
digital form and is compatible with existing sound processing methods, e.g., noise 
reduction algorithms and compression/expansion processing. The sound 
enhancement approach is compatible with, and additive to, any microphone 
directionality or noise cancelling technology. 

BRIEF DESCRIPTION OF THE DRAWING 

The present invention may be further understood from the following 

description in conjunction with the appended drawing. In the drawing: 

Figure 1 is a graph illustrating how the optimum mix ratio for two sound 
signals varies in accordance with the noise ratio of the two sound signals; 

Figiu-e 2 is a block diagram illustrating a beainfonning technique in 
accordance with one embodiment of the invention; 

Figure 3 is a graph illustrating one suitable control function for the power 
ratio block of Figure 2; 
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Figxire 4 is a graph illusdrating another control function for the power ratio 
block of Figure 2; 

Figure 5 is a graph illustrating relative noise improvement using the present 
beamforming technique as compared to using a 50/50 signal mix; 

Figure 6 is a graph illustrating relative noise improvement using the present 
beamforming technique as compared to using the quieter signal only; 

Figure 7 is a block diagram of a multiband beamformer; 

Figure 8 is a block diagram of a binaural beamformer; 

Figure 9 is a block diagram of a one embodiment of a DSP-based 
beamformer; 

Figure 10 is a block diagram of an alternative equivalent realization of the 
beamformer of Figure 9; 

Figure 1 1 is a block diagram of a another embodiment of a DSP-based 
beamformer; 

Figure 12 is a plot is a plot of the polar response patterns and DI values in a 
beamforming system using first-order directional microphones; 

Figure 13 is a plot of the polar response patterns and DI values of a 
conventional first-order microphone without beamforming; 

Figure 14 is a plot of the polar response patterns and DI values using 
second-order directional microphones; 

Figure 15 is a table showing interaural difference as a function of azunuth 
angle; 

Figure 16 is a graph correspondmg to the table of Figure 15; 

Figure 17 is a table corresponding to that of Figure 15, showmg propagation 
phase difference ("electrical'' phase difference) as a function of azimuth 
angle; 

Figure 18 is a table showing correction factors based on the data of Figure 
16 and Figure 17; 

Figure 19 is a table representing a control surface on which the correction 
factors of Figure 18 are located; 
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Figure 20 is a depiction of the control surface of Figure 19; 

Figure 21 is a graph of correction factor versus frequency; 

Figure 22 is a block diagram of a monaural beamforming system willi IAD 
correction; 

Figure 23 is a block diagram of a binaural beamforming system with IAD 
correction; and 

Figure 24 is plot is a plot of the polar response patterns and DI values in a 
beamforming system using first-order directional microphones and IAD 
correction. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Underlying the present invention is die recognition that, for any ratio of 
noise power in die binaural signals, for example, diere is an optimum mix ratio or 
weighting ratio that optimizes the SNR of the output signal. For example, if die 
noise power is equal in each signal, such as in a crowded restaurant widi people all 
around, movmg chairs, clattering plates, etc., dien die optimum weighting is 
50%/50%. In odier environments, die noise power in die two signals will be quite 
unequal, e.g., on the side of a road. If there is more noise in one signal by, for 
example lOdB, die optimum mix is not 50/50, but moves toward mcluding a greater 
amount of die quieter signal. In die case of a lOdB noise differential, die optimum 
noise mix is 92% quieter signal and 8% noisier signal. Such a result is 
counterintuitive, where intuition would suggest simply using die quieter signal. 
Simply using the quieter signal would be optimal only if the noise and voice bodi 
had die same amount of correlation. However, m nearly all real-world situations, 
die voice signals are highly correlated, while die noise signals are not. This 
dispari^ biases the optimum point. 

Figure 1 shows a comparison plot of voice power (target) and noise power in 
die ou^ut signal as a function of mix ratio. Note diat whereas die voice power stays 
constant widi mix ratio, the noise power does hot. Radier, as die ratio of noise 
power in die two signals increases (i.e., diere is a greater imbalance in die noise 
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"picked up** at each ear), the optimum mix ratio moves to weight the quieter signal 
heavier than the noisier signal before summing the two signals to form the output 
signal. The optimum mix ratio occurs where the noise in the output is minimum. 

Referring now to Figure 2, a block diagram is shown of a beamforming 
apparatus in accordance with one embodiment of the present invention. Assume a 
system having two input signals, i.e., a right ear signal and a left ear signal. The left 
ear signal is input in parallel to an attenuator and to a noise power determination 
block. The noise power determination block measures the noise power of the signal 
and outputs a noise level signal P^l- Similarly, the right ear signal is input in 
parallel to an attenuator and to a noise power determination block which outputs a 
signal Pnr. Noise level signals from the noise power determination blocks are input 
to a power ratio block, which determines, based on the relative noise levels of the 
two input signals, an appropriate weighting ratio, e.g., 50/50, 40/60, 60/40, etc. 
The weighting ratio may be determined using the following formulas: 

^ = fT 



^NL ^NR 



1- = w. 



Corresponding control signals are applied to the respective attenuators to 
cause the iiq>ut signals to be attenuated in proportion to ttie ii^ut signal's weighting 
ratio. For exainple, for a 60/40 weight, the left input signal is attenuated to 60% of 
its input value while the right input signal is attenuated to 40% of its input value. 
Attenuated versions of the input signals, attenuated by the optimiun amount, are 
then applied to a summing block, which sums the attenuated signals to produce an 
output signal that is then applied to both ears. 

Noise measurement may be jperformed as described m U.S. Application 
Serial No. 09/247,621 ffled February 10, 1999 (Attys. Dkt. No. 022577.530), 
incorporated herein by reference. Generally speaking, a noise measurement is 
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obtained by squaring the instantaneous signal and filtering the result using a 
low-pass filter or valley detector (opposite of peak detector). 

One suitable control function for the power ratio block is shown in Figure 3. 
As the noise power in one ear's signal exceeds the noise power in the other ear's 
signal, the optimum percentage of the noisier signal's contribution to the ou^ut 
signal decreases. In Figure 3, the comparison of noise powers is made using the 
decibel scale. If instead the comparison of noise powers is made using simple 
proportions, then the control function becomes linear as shown in Figure 4. 

The resulting SNR improvement over classical 50/50 beamforming achieved 
using the foregoing control strategy is shown in Figure 5. Realistic noise ratio 
values give relative SNR improvements that are dramatic. Figure 6 shows the 
resulting SNR improvement oyer using the quieter signal only. 

Assuming that the signal of mterest to the listener is straight ahead, then the 
signal of interest will be equal in both ears. Signals from other directions, which 
because of head shadowing are not equal in both ears, may therefore be considered 
to be noise. If a signal is equal in both ears, then beamforming has no effect on it. 
Therefore, although noise power detectors may be used as shown in Figure 2, a 
simpler approach is to use simple signal power detectors as shown and described 
hereafter in relation to Figure 9 and Figure 10. Interestmgly, one result of such a 
beamforming strategy is that the power in the signals from the two ears is equalized 
prior to combining the signals. 

As a further improvement, the foregoing approach to beardforming is not 
limited to simultaneous operation on the signals over their entire bandwidths. 
Rather, the same approach can be implemented on a 

frequency-band-by-frequency-band basis. Existing sound processing algorithms of 
the assignee divide the audio frequency bandwidth into multiple sejparate, narrower 
bands. By applying the current method separately to each band, the optimum SNR 
can be achieved on a band-by-band basis to further optimize tiie voice-to-noise ratio 
in the overall du^ut. 
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Referring more particularly to Figure 7, there is shown a multiband 
beamfonner in accordance with one embodiment of the invention. For each of the 
right ear and the left ear, a microphone produces an mput signal which is amplified 
and applied to a band-splitting filter (BSF). The BSF produces a number of 
narrower-band signals. Multiple beamformers (BF), one per band, are provided 
such as the beamfonner of Figure 2, Each beamfonner receives narrower-band 
signals of a particular band and produces an enhanced output signal for that band. 
The resulting enhanced band signals are then summed to form a final output signal 
that is output to bofli the right ear and the left ear. 

The multiband beamfonner has the advantage of optimally reducing 
background noises ft*om multiple sources with different spectral characteristics, for 
example a fan with mosdy low-frequency rumble on one side and a squeaky toy on 
the other. As long as the interferers occupy different frequency bands, this 
multiband approach improves upon the single band method discussed above. 

As a, further enhancement, some binaural cues can be left in the final output 
by biasmg the weightmgs slightly away from the optunum mix. For example, the 
right ear output signal might be weighted N% (say, 5-10%) away fi-om the optimum 
toward the right ear signal, and the left ear output signal might be weighted N% 
away from the optimxmi toward the left ear signal. To take a concrete example, if 
the optimum mix was 60% left and 40% right, then the right ear would get 55%L 
+ 45%R and the left ear would get 65%L + 35%R (with N = 5%). This 
anangement helps to make a more comfortable soimd and "externalizes the unage,*" 
i.e., causes the user to perceive an external aural envuronment containmg discernible 
sound sources. Furthermore, this arrangement entails some but very little 
compromise of SNR. Referring again to Figure 1, the shape of the curves is such 
that the minim a are broad and shallow. Appreciable deviation from the minimum 
can therefore be tolerated with very litde discernible decrease in noise reduction. 

More generally, N may be regarded as a "binaurality coefficient" that 
controls the amoimt of binaural information retained in the ou^ut. Suph a 
binaurality coefficient may be used to control the beamformer smoothly between full 
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binaural (N = 100%; no beamfonning) to full beamforming (N = 0%; no 
binaural). Tbiis binaurality parameter can be tailored for the individual. As this 
parameter is varied, there is little loss of directionality until after the binaural cues 
are significantly restored, so the directionali^r and noise reduction benefits of the 
beamformer's signal processing can still be realized even with a iisable level of 
binaural cue retention. 

Furthermore, human binaural processing tsods to be lost in proportion to 
hearing deficit. So those individuals most needing die benefits that can be provided 
by the beamforming algoritfmi tend to be those who have already lost the ability to 
beneficially utilize their namral binaural processing for extracting a voice from noise 
or babble. Thus, the algorithm can provide the greatest directionality benefit for 
those needing it the most, but can be adjusted, aldiough with a loss of directionality, 
for those with better binaural processing who need it less. 

Figure 8 shows a block diagram of a binaural sound enhancement system. 
Elements within the dashed-line block correspond to elements of the beamforming 
system of Figure 2. Now, however, instead of a single summing block, two 
summing blocks are provided, one to form the output signal for the right ear and 
one to form the ou^ut signal for the left ear. Ou^ut signals from variable 
attenuators are applied to both of the smnming blocks. In addition, fixed (or 
infrequently updated) attenuators are provided, one for each of the right ear signal 
and the left ear signal. ITie function of fliese attenuators is to provide an additional 
amount of an input signal to a corresponding one of die summing blocks. That is, a 
right fixed attenuator provides an additional amount of the right mput signal to the 
right summing block, which produces a right ou^ut signal, and a left fixed 
attenuator provides an additional amount of die left iiq)ut signal to the left summing 
block, which produces a left output signal. 

The foregoing approach to beamforming is simple and therefore easy to 
implement. Whereas die adaptive metiiod can take seconds to adapt, the present 
method can react nearly instantabeously to changes in noise or other varying 
environmental conditions such as die user's head position, since ifliere is no 
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adaptation requirement. The present method, thus, can remove impulse noise such 
as the sound of a fork dropped on a plate at a restaurant or the sound of a car door 
being closed. Furthermore, noise power detectors are ahready provided in some 
binaural hearing aid sets for use in noise-reduction algorithms. The simple addition 
of two multipliers (attenuators) and an additional processing step enables 
dramatically unproved results to be achieved. An important observation is that the 
improvement in voice-to-background noise that the invention provides is in addition 
to that of the noise-reduction created by pre-existing noise-reduction 
algorithms-further improving the SNR. 

Moreover, the foregoing methods all lend themselves to easy implementation 
in digital form, especially usmg a digital signal processor (DSP). In a DSP 
unplementation, all of tihie blocks are realized in the form of DSP code. Most of the 
requured software functions are simply multiplications (e.g., attenuators) or 
additions (sununing blocks). To do frequency band implementations, FFT methods 
may be employed. Outputs from FFT processes are easily analyzed as power spectra 
for implementing the noise power detectors. One such implementation divides the 
sound spectrum into 64 FFT bins and processes all 64 bins simultaneously every 3.5 
ms. Thus, the beamformer is able to adjust for various noise conditions in 64 
separate frequency bands at approximately 300 times each second. 

Referring to Figure 9, a block diagram is shown of a DSP-based monaural 
beamformer in accordance with one embodiment of the invention. The DSP 
approach uses well-known **overlap-add" techniques, various well-known details of 
which are omitted for sunplicity . In the arrangement of Figiu-e 9, a signal from a 
left-ear microphone Lin 901 is transformed using an FFT (Fast Fourier Transform) 
903 or similar transform. The resulting transformed signal feeds two separate 
operations, a squaring operation 905 and a multiplication operation 907. The 
multiplication operation may be considered as realizing ah attenuator where the 
attenuation ifactor is set by a circuit 909. A signal from a right-ear microphone Rin 
911 follows a corresponding path. Outputs of the miiltiplication operations for the 
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left ear and the right ear are summed (921), inverse-transformed (923) and output to 
transducers of bofli the left ear and the right ear (925 , 927) . 

The circuit 909 calculates attenuation ratios for the left and right ears by 
forming flie sum S of flie squares of flie signals and by forming 1) the ratio L/S of 
the square of the left ear signal to the sum; and 2) the ratio R/S of the square of the 
right ear signal to the sum. The operations for formmg these ratios are represented 
as an addition (931) and two divisions (933, 935). The resulting attenuation factors 
are coupled in cross-over fashion to the multipliers; that is, the signal L/S is used to 
control the multiplier for the right ear, and the signal R/S is used to control the 
multiplier for the left ear. Hence, as a noise source increases the signal level in one 
ear, the signal of the other ear is emphasized and the signal of the ear most 
influenced by the noise source is de-emphasized. 

The curcuitry may be simplified to conserve compute power by, mstead of 
performing two divisions, performing a single division and a subtraction as 
illustrated in Figure 10. That is, once one of die ratios has been determined, the 
other ratio can be determined by subti^cting the known ratio from 1 , since the ratios 
must add to 1 . 

An embodiment of a correspondmg binaural DSP-based beamfonner is 
shown in Figure 11. Note tiiat the operations within the block 1101 may be 
performed on a frequency-bm-by-frequency-bin basis. Hence, additional mstances 
of this block are indicated in dashed Imes. instead of the left input signal 
contributmg only to the left ouQ)ut signal and die right ii^)ut signal contributing only 
to the right output signal as in the previous embodiment, in this embodiment, die 
operations are arranged such that both ii^)ut signals may contiibute, in different 
amounts, to botii ouq)ut signals. That is, referring in particular to the cono-ol block 
1109, a binaurality conti-ol X is provided diat "biases'* the ouQ)ut signal for a 
particular ear toward the ii^ut signal for diat ear. The binaurality contirol may be 
realized by a subtraction operation 1103 and a multiplication operation 1105, and by 
an additional operation 1 107 and another niidtiplication operation i 1 1 1 . In order to 
retain beamforming operation while preserving binaxu-al cues to some de^ee, the 
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binaurality control might be set within a range of 5 to 15%. However, the 
binaurality control may also be set to one extreme or the other or anywhere in 
between. If the binaurality control is set to 0%, then operation becomes the same as 
in the case of the monaural beamformer of Figure 9. If the binaurality control is set 
to 100%, then fiiU-stereo operation ensues and any beamfonning action is lost. 

The remainder of the arrangement of Figure 1 1 may be appreciated by 
noting that tfie ou^ut processmg block 1021 of Figure 10 occurs twice, once for the 
left ear (1121a) and once for the right ear (1121b), since the output signals to the 
two ears may be different. Note also that in the arrangement of Figiure 11, two 
different nodes Y and Z correspond generally to die node W of Figure 10, reflecting 
the "biasing apart" of the two channels. (It is assumed in Figure 11, however, fliat 
the attenuation factors ^plied to the multipliers 1131 and 1133 are bounded within 
the range from 0 to 1 .) In oiflier respects, the arrangement of the two DSP-based 
embodiments is similar. 

To take a particular example of the operation of the arrangement of Figure 
11, assume tfiat the binaurality control is set to 10% . First assume a "no noise" 
situation in which the ratio L/S is 0.5. To obtain die signal at node Y, L/S is 
decreased by 10% to 0.45. At the same time, to obtam the signal at node Z, L/S is 
increased by 10% to 0.55. In die ou^ut processing stage, to form the left ouq>ut 
signal, the left input signal is multiplied by a factor 1-0.45 = 0.55, and the right 
output signal is multiplied by 0.45. To form die right output signal, die left input 
signal is multipUed by a factor 1 - 0.55 = 0.45, and die right output signal is 
multiplied by 0.55. 

Now assume a noisy situation in which die ratio L/S is 0.6. To obtain die 
signal at node Y, L/S is decreased by 10% to 0.54. At die same time, to obtain the 
signal at node Z, L/S is increased by 10% to 0.66. lii the output processing stage, to 
form die left ouQ)ut signal, die left input signal is multiplied by a factor 1-0.54 = 
0.46, and die right ou^ut signal is multiplied by 0.54. To form die right output 
signal, die left ii^ut signal is multiplied by a factor 1 - 0.66 = 0.44, and the right 
ou^ut signal is multiplied by 0.66. In bodi ou^ut signals, the right (quieter) input 
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signal is weighted more heavily, but in the left output signal, the left input signal is 
weighted more heavily than it would otherwise be, and in the right output signal, the 
right input signal is weighted more heavUy than it would otherwise be for optimum 
noise reduction. 

In accordance with a ftirther aspect of the invention, beamforining can be 
performed selectively within one or more frequency ranges. In particular, since 
most binaural directionality cues are carried by the lower frequencies (typically 
below 1000 Hz), an enhancement to the beamformer would be to pass the 
frequencies below, say, 1000 Hz directly to their respective ears, while 
beamfonning only those frequency bins above that frequency in order to achieve 
better SNR in the higher frequency band where directionality cues are not needed. 

In one implementation, the beamforming algoridim is simply applied only to 
the higher frequencies as stated. 

In another implementation, a look-up table is provided having a series of 
"binaurality** coefficients, one for each frequency bin, to control the amount of 
binaural cues retained at each frequency. The use of such a "binaurality coefficient" 
to control the beamformer smoothly between full binaural (no beamforming) to full 
beamforming (no binaural) has been previously described. By extending this concept 
to provide for per-bin binaurality coefficients, the coefficients for each low 
frequency bin may be biased far toward, or even at, full binaural processing, while 
the coefficients for each high frequency bin may be biased toward, or completely at, 
fiiU beamforming, thus achieving die desired action. Although the coefficients could 
abruptly change at some frequency, such as 1000 Hz, more preferably, the 
transition occurs graduaUy over, say, 800 Hz to 1200 Hz, where the coefficients 
"fade*' smoothly from full binaural to full beamforming. 

Note that other beamforming methods, although inferior to those disclosed, 
may also be used to enhance sound signals. In addition, a beamformer as described 
herein can be used in products other than hearing aids, i.e., anywhere that a more 
/^focused" sound pickup is desired. 
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EXAMPLE 

The foregoing beamfonning methods demonstrate very high directionality, 
and enable the user of a binaural hearing aid product to be provided with a "super 
directionality" mode of operation for those noisy situations where conversation is 
otherwise extremely difficult. Second-order microphone technology may be used to 
further enhance directionality. 

The described beamformer was modeled in die dSpace/MatLab environment, 
and the MLSSA method of durectionality measurement was implemented in the same 
environment. The MLSSA method, which uses signal autocorrelation, is quite 
immune to ambient noises and gives very clean results. Only data for the usual 500, 
1000, 2000 and 4000 Hz frequencies was recorded. Two BZ5 first-order directional 
microphones were placed in-sita on a KEMAR mannequin, and the Ox axis was 
taken to be a line straight in front of die mannequin as is standard practice. 
Measurements were taken at 3.75 x increments between ±30 x and at 15 x 
mcrements elsewhere. Care was taken to ensure that the system was working well 
above die noise floor and below saturation or clipping, 

Figiire 12 shows the polar response characteristics and the calculated 
Directionality Index (DI) of die beamfonning system for each of die four recorded 
frequencies. Beamforming inherendy affects only die horizontal characteristics of 
die directional pattern and does not affect symmetry about die front-to-back axis. A 
narrowed horizontal pattern wifli left-right symmetry is therefore expected and is 
demonstrated in Figure 12. 

As compared to DI values for a single microphone, shown in Figure 13, the 
calculated in-sita DI values of Figure 12 demonstrate a remarkable improvement, 
averaging upwards of 9dB over die four tested frequencies as compared to a value 
of less dian about 5dB for typical first-order microphones. The benefits of die 
described beamformer are dierefore clearly evident: higher dkectionaiity can be 
achieved dian widi any single or binaural pair of hearing aid acting independentiy . 

Directionality can be in^roved further still using second-order microphones. 
Since die second-order microphones have superior directionality, as compared to 
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first-order designs, especially with respect to their front-to-back ratio, this property 
of the second-order microphone complements the beamformer's processing 
algorithm, which is limited to side-to-side enhancement. Thus, the combined result 
is a very narrow, forward-only beam pattern as shown in Figure 14, 

Unlike prior art beamformers, the present beamforming technique is based 
upon Head Related Transfer Functions (HRTFs) documented in the paper by 
E.A.G. Shaw. HRTFs describe the effects of the head upon signal reception at the 
ears, and include what is called "head shadowing." In particular, the present method 
uses the head shadowing effect to optimize SNR. 

Furthermore, whereas prior art beamforming systems usually include delay 
or phase shift of signals in addition to amplitude-based operations, the foregoing 
embodiments of the present beamformer do not. Only amplitudes are adjusted or 
modified-thereby making the present beamformer simpler and less costly to 
implement. 

In other embodiments, however, phase adjustment may be used to provide a 
more natural sound quality and in fact to further improve the directionality of the 
beamformer. Note that in the pattern of Figure 12, for example, peaks and nulls 
occur at different positions for different frequencies. The cause of these peaks and 
nulls in the beam pattern is the relative signal phase between right ear and left ear 
signals (as distinguished from head shadowing, which is relates to the amplitude 
difference-Interaural Difference, or IAD-caused by the head). The relative signal 
phase between the right ear and left ear signals is due to the path length difference 
for off-axis signals-i.e. flie signal from a source located, say, 45 degrees to the 
right will arrive at the right ear before it arrives at the left ear. The path length 
difference translates directly into a delay time, because of the essentially constant 
speed of sound in air. In turn, a constant delay translates directly into a phase shift 
which is directly proportional to frequency. 

As previously described, the basic beamformer algorithm has the attribute of 
matching (in ampliitude) the contribtition from each ear's signal to the output. 
Accordingly, an Nxl80 degree phase shift will create a deep null, i.e. nearly perfect 
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canceUation, and an Nx360 degree phase shift will create a +6-dB peak. This is one 
reason why the beamformer polar pattern shows such distinct peaks and nulls. If the 
amplitudes weren't well matched, the peaks and nulls would be much less distinct, 
although there would still be as many and at the same angle locations. 

Due to the relatively large spacing between tiie two ear microphones 
(sensors), a large path length difference for the two signals exists. In tum, this 
creates a large phase shift for relatively small off-axis (azimuthal) angles, and thus, 
enough phase shift to reach 180, 360, 540, 720, etc. electrical degrees for arrival 
angles between 0 and 90 azunuthal degrees, especially at the higher fi-equencies. 
This is the second reason that the beamformer pattern shows nxmierous peaks and 
nulls. A closer spacing (a pin head, for example) would move the peaks and nulls 
azimuthally toward 90 degrees, so that fewer would show up. If the spacing were 
small enough, no peaks or nulls would show up at all, except at very high 
frequencies. 

The most desirable response pattern in Figure 12 is the response pattern for 
lOOOHz. The following description will describe how the response patterns for other 
ft^equencies can be made to have a very similar response pattern, resulting in a more 
natural sound and greater directionality. 

Referring to Figure 15, a table is shown presenting known data regarding 
IAD as a function of azunuthal angle. This data may be represented graphically as 
shown in Figure 16. As seen in Figure 16, depending on frequency, IAD is quite 
linear from 0 degrees azunuflial angle to between 40 and 7p degrees azimuthal angle 

Figure 17 shows a partial table of the azunuthal dependence of electrical 
phase difference in the embodiment of the beamformer previously described. 
Agreement between Figure 17 and Figure 12 may be readily observed. A clear 
pattem emerges from Figure 17, i.e., each time the frequency is halved (from 4kHz 
to 2kHz, 2kHz to IkHz, etc.), as would be expected, the azimuthal angle for a 
particular null or peak doubles. For example, at 4kHz, the first null occurs at 15 
degrees. At 2kHz, the first null occurs at 30 degrees. In order to "equalize" the 
phases of the various signals to match the phase of the IkHz signal, the following 
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actions are required: at 500Hz, double the (azimuthal-angle-dependent) phase rate; 
at IkHz, do nothmg; at 2kHz, halve the phase rate; and at 4kHz, quarter the phase 
rate. 

Since IAD ahready forms the basis of the beamformer as previously 
described, it is desirable to, for each frequency, obtain a phase correction fector in 
terms of IAD (measured m dB) to be applied to the signal at that frequency to bring 
that signal substantially into phase with the IkHz signal. These correction factors 
may be obtained in the manner shown in Figure 18. An IAD slope (in dB/ADeg.) is 
obtained from Figure 16, and a phase slope (EDeg./ADeg.) is obtained from Figure 
17. Dividing the latter by the former results in the phase rate (EDeg./dB). Given the 
phase rate for a particular frequency, the action to be taken at that frequency 
determines the appropriate correction factor. For example, at 500Hz, the phase rate 
is to be doubled. Since the phase rate is 6.563 EDeg./dB, the correction to be 
applied is also 6.563 EDeg./dB. At 2kHz, the phase rate (36 EDeg./dB) is to be 
halved, resultuig in a correction of -18 EDeg./dB. 

Using the correction values of Figure 18, a table representing a control 
surface for performing phase "equalization" may be obtained as shown in Figure 
19. A graph of the control surface is shown in Figiu-e 20. The information of Figure 
19 and Figure 20 may be rqpresented more compactly in the form of a correction 
slope graph, shown in Figure 21. If a look-up table approach to phase equali^tion 
is used, then the representation of Figure 19 and Figure 20 is preferred. If a 
mathematical approach to phase equalization is used, flien the representation of 
Figure 21 is preferred. 

Referring to Figure 22, a block diagram is shown of a monaural beamformer 
like that of Figure 10, modified to perform phase equalization as described. A phase 
controller 2201 is responsive to the signal W to produce frequency-dependent phase 
corrections to be applied to different frequency components. The phase controller 
may take the form of a lookup table or a mathematical calculation. A phase ^fter 
block 2i203 receives fht phase corrections from the phase controller and ^^plies flie 
phase corrections to the different frequency components. Similar components 2201' 
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and 2203' appear in dashed lines in the right ear signal path. Whether elements 2201 
and 2203 are used or elements 2201' and 2203' are used, the result is the same. 
Alternatively, both elements 2201 and 2203 and elements 2201' and 2203' may be 
used, in which case the phase corrections would be halved such that half of the shift 
is applied in each of the left ear path and the right ear path. Figure 23 shows an 
embodiment of a corresponding binaural beamformer, includmg phase controllers 
2301 and 2301' and phase shifter blocks 2303 and 2303'. 

The expected results of phase correction are shown in Figure 24. In the case 
of the frontal lobe, the response pattern is very similar regardless of frequency. 
Furthermore, in comparison with Figure 12, the DI values of Figure 24 show 
substantial improvement. 

Although the present invention has been described primarily m a hearing 
health care context, the principles of the invention can be applied in any situation in 
which an obstacle to energy propagation is present between sensors or is provided to 
create a shadowing effect like the head shadowing effect m hearing health care 
applications. The energy may be acoustic, electromagnetic, or even optical. The 
invention should therefore be understood to be applicable to sonar applications, 
medical imaging applications, etc. 

It will be appreciated by those of ordinary skill in the art that the invention 
can be embodied in other specific forms without departing from the spirit or 
essential character thereof. The presently disclosed embodiments are therefore 
considerwi in all respects to be illustrative and not restrictive. The scope of the 
invention is indicated by the appended claims rather than flie foregomg description, 
and all changes which come within flie meaning and range of equivalents thereof are 
intended to be embraced therein. 



